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Abstract 

Background: Over the past decade, substantial global investment has been made to support health systems and 
policy research (HSPR), with considerable resources allocated to training. In Canada, signs point to a larger and 
more highly skilled HSPR workforce, but little is known about whether growth in HSPR human resource capacity is 
aligned with investments in other research infrastructure, or what happens to HSPR graduates following training. 

Methods: We collected data from the Canadian Institutes of Health Research, Canada's national health research 
funding agency, and the Canadian Association for Health Services and Policy Research on recent graduates in the 
HSPR workforce. We also surveyed 45 Canadian HSPR training programs to determine what information they collect 
on the career experiences of graduates. 

Results: No university programs are currently engaged in systematic follow-up. Collaborative training programs 
funded by the national health research funding agency report performing short-term mandated tracking activities, 
but whether and how data are used is unclear. No programs collected information about whether graduates were 
using skills obtained in training, though information collected by the national funding agency suggests a minority 
(<30%) of doctoral-level trainees moving on to academic careers. 

Conclusions: Significant investments have been made to increase HSPR capacity in Canada and around the world 
but no systematic attempts to evaluate the impact of these investments have been made. As a research 
community, we have the expertise and responsibility to evaluate our health research human resources and should 
strive to build a stronger knowledge base to inform future investment in HSPR research capacity. 
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Background 

Over the past decade, significant investments have been 
made globally to support health systems and policy re- 
search (HSPR) with the ultimate goal of contributing to 
high-quality, accessible, and sustainable health care systems 
[1,2]. These investments have taken multiple forms, sup- 
porting both training and development of an HSPR work- 
force, as well as investments in research infrastructure. 
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The Canadian HSPR community has grown and trans- 
formed as a result of these investments; signs now point 
to a larger, younger, and more highly skilled HSPR com- 
munity [3], Developments in infrastructure, encompass- 
ing supportive research environments and tools (such as 
accessible data) are less apparent. If growth in human 
resource capacity has outpaced development of such re- 
search infrastructure, Canada's transformed HSPR work- 
force may not be well-positioned to achieve its potential. 
Careful tracking of career trajectories and research outputs 
is required to ensure that investments in human resource 
capacity are yielding the desired growth in high-quality, 
relevant research [1]. 

The importance of conducting research on health re- 
search systems is gaining recognition [4]. A prominent 
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stream in HSPR is the examination of health human re- 
source capacity, which explores whether the health care 
workforce is meeting the needs of the population. This 
paper represents a first attempt to apply a similar lens to 
workforce issues facing the HSPR community in Canada. 

Trends in the broader scientific workforce 

In other scientific disciplines, large increases in the 
number of graduates with advanced training have not 
been matched with growth in work opportunities that 
take advantage of trainees' qualifications [5], The num- 
ber of completed science doctorates grew by 40% in 
OECD countries between 1998 and 2008, yet in the 
United States (US), the proportion of PhD graduates 
who received tenured academic positions within six 
years of completing their PhD fell from 55% in 1973 to 
15% in 2006 [5]. Of course, unemployment among those 
with advanced degrees remains low, but the proportion 
of doctorates taking jobs that do not require a PhD is 
growing, as is the time it takes for graduates to find 
stable, rewarding positions [6]. This has broader implica- 
tions, as it may signal that funding for training and 
scientific capacity development could be better directed. 
Whether these broad trends play out within HSPR is not 
known. 

Knowledge of the HSPR workforce 

For the purpose of this study, we use the Canadian Insti- 
tutes of Health Research (CIHR) definition of health ser- 
vices and policy research to define the broad field of 
health systems and policy research "as research designed 
to improve the way health care services are organized, 
regulated, managed, financed, paid for, used, and deliv- 
ered" [1]. A 2007 AcademyHealth inventory of Health 
Services Research (HSR) training programs found 124 
graduate programs in the US and Canada which gradu- 
ate approximately 4,500 Master's and 150-300 PhD 
students per year [7]. The US HSR field has grown from 
an estimated 5,000 health services researchers in 1995 to 
11,600 in 2007 [8]. At the same time, US HSR funding 
declined (adjusted for inflation), pointing to a potential 
misalignment between workforce growth and opportun- 
ities for research funding and employment [9]. Know- 
ledge of the HSPR workforce in the European context is 
even more limited as there is no Europe-wide HSPR 
society. Some countries do have professional HSPR orga- 
nizations and national conferences [2,10]; however, this 
fragmentation hampers efforts to measure HSPR cap- 
acity globally. 

Understanding the dynamics of the HSPR workforce is 
complicated by the diverse nature of the field, as re- 
searchers come from a variety of disciplines, collaborate 
internationally, and work in a wide range of settings 
[9,11]. US AcademyHealth membership indicates that 



nearly half of health services researchers were working 
in universities or teaching hospitals, one third in the pri- 
vate sector or foundations, and 10% in government 
agencies [8]. There is a noted lack of information on the 
HSPR workforce in Europe, where there are large differ- 
ences in training opportunities among countries [10]. A 
report on HSPR capacity building in Canada (based on 
stakeholder interviews and a document review) concluded 
that good evidence is not available to capture Canada's 
current HSPR human resource capacity; thus providing 
no information to direct further capacity building efforts 
[12]. To our knowledge, no Canadian studies have ad- 
dressed this gap. 

Capacity development efforts in Canada 

There have been considerable investments in the devel- 
opment of HSPR capacity in Canada over the past 10 
to 15 years [3]. In 1999, the Canadian Health Services 
Research Foundation and the CIHR jointly launched the 
Capacity for Applied and Developmental Research and 
Evaluation (CADRE) program, a major 10-year capacity 
development initiative. CADRE supported mentoring 
chair awards, five Regional Training Centers (RTCs), post- 
doctoral awards, and career reorientation awards, with a 
total of $6.5 million in funding each year [13]. The RTCs 
provided students with the opportunity to collaborate 
with decision makers, gain an interdisciplinary per- 
spective, and develop skills in research methods [13,14]. 
Shortly thereafter, in 2001, CIHR launched the $85 million 
Strategic Training in Health Research (STIHR) initiative 
to increase health research capacity through training and 
development of researchers, in health services as well as 
other areas [15]. 

These direct investments in HSPR human resource 
capacity coincide with other policies that supported in- 
creased opportunities for advanced training. The estab- 
lishment of CIHR's Institute of Health Services and 
Policy Research in 2000 marked a profound change in 
the funding of HSPR research [16]. Prior to this, HSPR 
researchers were dependent on highly competitive fel- 
lowships funded through the Natural Sciences and 
Engineering Research Council of Canada. CIHR now 
provides targeted funding for student traineeships tied 
to operating grants, as well as master's, doctoral, and 
post-doctoral awards. Figure 1 shows the marked in- 
creases in the number of master's, doctoral, and post- 
doctoral awards, as well as more modest growth in new 
investigator salary awards. This figure does not capture re- 
search traineeships through operating grants, or through 
the RTC or STIHR programs. 

Given these large investments in human resource 
capacity, we explored what information is collected on 
post-training activities of individuals who have recendy 
graduated into the HSPR workforce in Canada. This is a 
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Figure 1 Number of health systems and services CIHR-funded training and salary awards, by year. 



first step in determining what is known, and what remains 
unknown, about the alignment between HSPR human re- 
source capacity and research infrastructure. 

Looking forward, we considered how we as both Canadian 
and international research communities might take steps 
to ensure that we fully capitalize on investments in human 
resource capacity. 

Methods 

We collected data on recent graduates in the HSPR 
workforce from the CIHR, Canada's national health re- 
search funding agency, and the Canadian Association of 
Health Services and Policy Research (CAHSPR), Canada's 
national HSPR professional association. CIHR provided 
data on grant funding trajectories of previous doctoral 
award recipients. CAHSPR provided data on membership 
and annual conference registration. 

These two data sources include only those young re- 
searchers who received CIHR doctoral funding or who 
were CAHSPR members or conference attendees, and are 
therefore incomplete in their ability to inform current 
workforce dynamics. To complement these sources, we 
conducted a survey of all Canadian university programs 
that provide HSPR training. We scanned Canadian univer- 
sity websites for programs that self-identified as providing 
graduate HSPR training, either via specific programs or 
within larger departments. The following were included: 
i) programs that offer research degrees in HSPR; ii) pro- 
grams that offer research degrees in public, population, or 
community health, with options for HSPR specialization; 
and iii) graduate nursing programs that made specific 
reference to 'health services or systems research'. Clinical 
fellowships with a research component or other MD pre- 
requisite programs, executive programs, coursework-only 
degree programs, MBA or law specializations, information 
sciences, and public policy without explicit mention of 
health services or health systems were excluded. We then 
asked each of the identified programs/departments to 



confirm that they were in fact providing HSPR train- 
ing, ensuring that we were only collecting data from 
relevant programs. A total of 45 programs were iden- 
tified: 33 university-based programs and 12 collabora- 
tive and agency-based programs (RTCs and STIHRs). An 
additional file provides the list of HSPR training programs 
we included in our sample [Additional file 1]. 

We collected data between April and August of 2012. 
The email survey was sent to program directors and 
copied to assistant directors and program administrators 
where email addresses were publically available. Recipi- 
ents were requested to forward the survey to the appro- 
priate individual if misaddressed. The email included a 
short preamble introducing the CAHSPR Student Work- 
ing Group, the survey objectives, and four open-ended 
questions (see below). The survey took less than ten mi- 
nutes to complete and was sent in both English and 
French. 

The four survey open-ended questions 

i. ) Does [Program, School, or Department name] offer 

programs that provide training related to health 
services and policy research (HSPR)? If so, please 
list them. 

HSPR has been defined by CIHR as research 
designed to improve the way health care services are 
organized, regulated, managed, financed, paid for, 
used, and delivered. Training could include a formal 
stream or certification, elective course offerings, or 
relevant research experience. Programs could include 
degrees (e.g., MPH, MSc, PhD), certificates, or 
fellowships. 

ii. ) How many students graduated from each identified 

program in the past three years (September 
2008-November 2010)? 

iii. ) Have you collected information on the career 

experiences of previous graduates, following 
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completion of these programs? For example, did 
they secure employment following graduation? If so, 
in what field (e.g., HSPR, public health, non-health- 
related) and sector (e.g., academia, health services 
delivery organization, government)? 
If you have collected information, please describe in 
a few sentences the process you used, what types of 
information you gathered, and the years for which 
this was undertaken. 
iv.) How many young investigators have been hired 
by your program within the past five years 
(July 2006-November 2010) who work in the area 
of HSPR? 

A new investigator is defined as someone who has 
held a full-time research appointment for fewer than 
five years. 

A reminder email was sent two weeks after the initial 
email request, followed by reminder phone calls to the 
program director or program administrator (extracted 
from contact information on program web pages) four, 
six, and eight weeks after the initial email request. When 
personal contact was not made, a voice mail message was 
left followed by another reminder email. 

Results 

CIHR's Institute of Health Services and Policy Research 
collects data on whether doctoral research award holders 
receive subsequent funding through grants. On average, 
30% of graduated doctoral award holders receive grant 
funding and are assumed to be working in academia (in 
grant-tenured, tenure-track, or non-tenured academic po- 
sitions). This figure rises to 71.4% among post-doctoral re- 
search award holders. Data from the CAHSPR conference 
reveal a young and growing community. Conference at- 
tendance grew from 443 in 2009 to 578 in 2012, with 35% 
of 2012 attendees registered as students. These data, how- 
ever, provide a very limited picture of the HSPR work- 
force. There is no information about doctoral award 
winners who do not end up in academia, or trainees who 
did not receive CIHR awards. The question as to whether 
graduates are finding opportunities that use the skills they 
have acquired remains. 

We sent our survey to 45 Canadian university and col- 
laborative/agency-based programs. Of the 33 university 
programs contacted, we had a 61% response rate of which 
75% confirmed provision of HSPR-specific training. Of the 
12 collaborative and agency-based programs contacted, 
83% responded, of which 58% confirmed HSPR training 
(Figure 2). Of these, three university programs and two 
RTC/STIHRs reported not having explicit HSPR pro- 
grams, but provided support to students taking courses in 
HSPR and carrying out HSPR thesis research. Subsequent 
results focus on the 15 university and 7 RTC/STIHR 
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Figure 2 Survey responses from HSPR programs in Canada. 



programs that responded and confirmed they provided 
HSPR training. 

The majority of university HSPR program responses 
were concentrated in Ontario, with a handful of pro- 
grams in other provinces (Table 1). Most university pro- 
grams (66.7%) graduated five or fewer HSPR students 
per year, likely because they are part of larger programs 
that offer some opportunity for HSPR specialization. In 
contrast, all but one RTC/STIHR program graduated 



Table 1 Tracking activities of responding programs 



University 
programs (n = 15) 



RTC/STIHR 

(n = 7) 





n (%) 


n (%) 


Program location* 






British Columbia 


1 (67) 


1 (14.3) 


Alberta 


1 (67) 


0 (0.0) 


Manitoba 


0 (0.0) 


0 (0.0) 


Ontario 


1 0 (667) 


5 (71.4) 


Quebec 


2 (13.3) 


1 (14.3) 


Nova Scotia 


1 (6.7) 


0 (0.0) 


Program size (graduates)** 






Small (< 5) 


1 0 (667) 


1 (14.3) 


Medium (>5 and < 20) 


2 (13.3) 


3 (42.9) 


Large (>20) 


2 (13.3) 


2 (28.6) 


Tracking activities 






One-time collection 


1 (67) 


3 (42.9) 


Ongoing follow-up 


2 (13.3) 


4(57.1) 


None 


1 2 (80.0) 


0 (0.0) 



*Of the university programs that did not respond, 3 were in British Columbia, 
2 in Alberta, 1 in Saskatchewan, 1 in Manitoba, 3 in Ontario, 2 in Nova Scotia, 
and 1 in Newfoundland. Of the RTC/STIHRs that did not respond, 1 was in 
Quebec and 1 in the Maritimes. One STIHR supports training in Ontario and 
Western provinces. 

**One university and one RTC program did not report the number of 
graduates over the past three years. 
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more than five students per year, reflecting the focused 
HSPR training provided by RTC programs. 

University programs do not consistently track students 
after graduation. Eighty percent do not track their grad- 
uates at all, providing only anecdotal examples of posi- 
tions obtained (Table 1). All RTC/STIHR programs report 
tracking their graduate students, as mandated in their 
funding arrangements. Whether and how these data are 
used remains unclear. Three RTC/STIHR programs re- 
ported one-time data collection and four reported ongoing 
follow-up. 

Only two (13.3%) university programs were able to 
provide information about their graduates' careers (both 
graduating fewer than 5 trainees per year), compared to 
all seven RTC/STIHR program respondents. The univer- 
sity programs indicated that only nine (6.8%) of their re- 
corded graduates obtained post-doctoral fellowships or 
research staff positions. Twenty-four (8.7%) of the 283 
students who participated in RTC/STIHR programs 
were confirmed to be in HSPR faculty/ teaching positions 
post-graduation. However, students in the RTC/STIHR 
programs come from a wide range of fields, and thus 
may be in faculty positions outside of HSPR. 

University programs reported hiring a total of 7 young in- 
vestigators that work in the area of HSPR over the period 
of July 2006 to November 2010. While this is not an accur- 
ate count of all academic hires of young HSPR investigators 
over this period, to our knowledge this information has not 
been tracked elsewhere. RTC/STIHR programs do not hire 
faculty or offer teaching positions. 

No programs reported collecting information pertain- 
ing to whether their training had equipped graduates 
with the skills they needed post-graduation, nor assessed 
whether graduates were in positions that satisfied them 
or corresponded to their level of training. 

Discussion 

The results of our survey demonstrate that most Canadian 
university programs do not follow their graduates in a 
systematic fashion, and data collected by relevant na- 
tional organizations is limited. While RTC/STIHRs col- 
lected information on positions held by their graduates, 
there has been no reported examination of whether those 
graduates make full use of their training, or whether it has 
equipped them with relevant skills. There were also con- 
siderable challenges in comparing data across programs 
due to differences in definitions of participating students, 
as well as strategies and time frames for data collection. 
While a midterm review in 2008 reported that the RTCs 
were valued by both students and decision-makers, there 
were concerns about the quality of RTCs tracking data 
[17]. A final evaluation of the RTCs has been commis- 
sioned, although at the time of writing of this paper, it had 
not yet been released. 



Combining our survey results with the information 
collected by CAHSPR and CIHR, it is clear that there 
has been growth in HSPR training over the past decade, 
with a minority of trainees moving on to academic ca- 
reers. However, much remains unknown about gradu- 
ates' career experiences and trajectories. As universities, 
funding bodies, government agencies, and research orga- 
nizations have all played roles in the development of 
HSPR capacity in Canada and internationally, they also 
have roles to play in collecting information to inform 
this issue, and taking steps to ensure human resource 
capacity and research infrastructure are aligned. 

Data on graduate employment would be useful to uni- 
versity departments and training programs as a tool for 
evaluating the quality of their programs and identifying 
opportunities for improvement. More specifically, these 
data could provide information on whether programs 
equip trainees with core competencies that match future 
career requirements [18]. Commenting on the scientific 
community more broadly, Kennedy et al. [6] suggest 
university departments give applicants a detailed account 
of the placement histories of recent graduates. As our 
results show, no departments surveyed currently possess 
this information. More careful tracking of graduates is a 
necessary first step. Research funders also have a role to 
play, ensuring that investments in human resource cap- 
acity are matched with support for research infrastruc- 
ture, and ensuring that available support is balanced 
over the course of research careers. Support for new in- 
vestigators has been identified as one possible gap in 
current career support funding [12]. While academic in- 
stitutions are responsible for hiring faculty positions, 
models to support research infrastructure outside of the 
academic environment should also be explored. 

Various factors may contribute to demand for HSPR 
and a need for growth in the field. In the US, demand for 
HSPR is expected to grow with large short-term funding 
increases resulting from the recent economic stimulus 
and health care reforms [9,19]. Expanding health data 
availability and complexity, the need for faster and more 
efficient knowledge translation, and pressures to cut costs 
in the health system may also continue to drive demand 
[7]. In Europe, the European Commission has funded 
'HSR Europe' to identify research priorities in health ser- 
vices research, build health services research capacity, 
organize the health services research community, and de- 
fine the relationship between research and policy [2]. It 
is also important to recognize that HSPR funding is un- 
balanced across countries, with low income countries fur- 
ther challenged by weak institutional capacity and a lack of 
critical mass within institutions [20]. Canada, and other 
high-income countries, may have a role to play in the de- 
velopment of the field internationally, in order to maximize 
global health system improvement [4] . 
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While these forces may justify continued growth in 
Canada, to date, there is little information on current re- 
search capacity, let alone predictions of future needs. 
Better evidence will help to determine if continued in- 
vestment in human resource development is warranted, 
or if resources could be better spent elsewhere in order 
to fulfill the objective of supporting high-quality, rele- 
vant research. Approaches to studying research capacity 
may be adapted from other jurisdictions to provide 
needed information on current research capacity and fu- 
ture needs specific to Canada [8,21,22]. 

Finally, we note that our study faces limitations inher- 
ent to self-report surveys. Though self-report surveys 
are not the ideal method of data collection, no other 
data was available to triangulate our results, and we be- 
lieve this study is an important first step in understand- 
ing capacity development in Canada and identifying a 
lack of data collection on HSPR trainees. 

Conclusions 

Over the past few decades, significant investments have 
been made to increase HSPR capacity worldwide, particu- 
larly in the area of training. Evidence suggests we now 
have many young, highly-trained students and new gradu- 
ates. We know little, however, about the career trajectories 
of these students when they complete their advanced de- 
grees. In Canada, university departments, training centers, 
and health research hinders are only minimally engaged 
in student follow-up. A concerted and systematic, longi- 
tudinal effort to build a stronger knowledge base about 
HSPR capacity development is needed to inform future 
investment. 

Additional file 



Additional file 1: List of programs offering graduate HSPR training. 
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